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Conference  on  Acoustics,  Speech,  and  Signal  Processing,  In  Tulsa 

"^The  main  emphasis  of  the  talk  was  on  explaining  coherence  and  Its  useful 
ness.  The  paper  given  In  the  coherence  record  emphasizes  how  to  estimate 
coherence  and  how  accurately  this  can  be  done.  In  underwater  acoustics  where 


signals  are  digitally  processed  at  the  outputs  of  two  or  more  receiving  sensors 
It  is  desirable  to  estimate  the  coherence  spectrum,  both  for  detection  and 
position  estimation^) 

processing  technique  for  computing  arbitrary  confidence  bounds  for 
stationary  Gaussian  signals  is  presented.  New  computationally  difficult 
examples  are  given  for  80-95  percent  confidence  with  Independent  averages 
of  8,  16,  32,  64,  and  128.  A discussion  of  the  computational  difficulties 
together  with  algorithmic  details  (including  the  FORTRAN  program)  are 
presented . 
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CONFIDENCE  BOUNDS  FOR  MAGNITUDE-SQUARED 
COHERENCE  ESTIMATES 


• Wh at  is  coherence? 

• How  and  how  accurately 
do  you  estimate  it? 


The  purpose  of  this  talk  is  to  ansmer  two 
FUNDAMENTAL  QUESTIONS:  FIRST,  WHAT  IS  COHERENCE; 
SECOND,  HOW  DO  YOU  ESTIMATE  COHERENCE  AND  HOW 
ACCURATE  CAN  THIS  ESTIMATION  BE. 

The  main  emphasis  of  this  talk  is  the 

EXPLANATION  OF  COHERENCE  AND  ITS  USEFULNESS. 

The  paper  given  in  the  conference  record  empha- 
sizes HOW  TO  ESTIMATE  COHERENCE  AND  HOW  ACCURATELY 
THIS  CAN  BE  DONE.  The  IMPORTANCE  OF  DETERMINING 
CONFIDENCE  BOUNDS  FOR  ESTIMATES  OF  COHERENCE  WILL 
ONLY  BE  APPARENT  TO  SOMEONE  WHO  WANTS  TO  ESTIMATE 
COHERENCE.  THUS,  THE  TALK  THIS  MORNING  WILL  SHOW 
HOW  USEFUL  THE  COHERENCE  IS  AND  HOW  TO  USE  THE 
RESULTS  IN  THE  COHERENCE  RECORD  TO  DETERMINE  THE 
ACCURACY  WITH  WHICH  THE  COHERENCE  CAN  BE 
ESTIMATED. 


NEXT  SLIDE  PLEASE- 


Tib 


s«b  w 

[G.W  Gb(F)]V* 


o < |Y4b(f)|2  < l,  vf 


a,b  either  source,  receiver  pair 
or  receiver,  receiver  pair 


The  term  coherence  has  several  different 

MEANINGS  AND  DEFINITIONS.  ThE  ONE  WE  USE  HERE 
IS  THE  COMPLEX  COHERENCE  OR  COEFFICIENT  OF 
COHERENCY  DEFINED  BY  MeINER  IN  1930.  FOP  OUR 


PURPOSES,  WE  DEFINE  THE  COHERENCE  BETWEEN  TWO 
STATIONARY  RANDOM  PROCESSES,  A AND  B,  AS  THE 
CROSS  POWER  SPECTRUM  DIVIDED  BY  THE  SOUARE  ROOT 
OF  THE  PRODUCT  OF  THE  AUTO  POWER  SPECTRA.  THE 
COHERENCE  IS  A FUNCTION  OF  FREOUENCY  AND  HAS 
THE  USEFUL  PROPERTY  THAT  ITS  MAGNITUDE  SOUARED 
IS  BOUNDED  BETWEEN  ZERO  AND  UNITY.  IT  IS  A 
NORMALIZED  CROSS  SPECTRAL  DENSITY  THAT,  IN 
SOME  SENSE,  MEASURES  THE  EXTENT  TO  WHICH  TWO 
RANDOM  PROCESSES  ARE  SIMILAR.  FOR  EXAMPLE, 

TWO  UNCORRELATED  RANDOM  PROCESSES  ARE  INCOHERENT; 
THAT  IS,  THE  COHERENCE  IS  ZERO  BETWEEN  UNCORRE- 
LATED processes.  Further,  the  coherence  between 
TWO  LINEARLY  RELATED  PROCESSES  IS  UNITY.  The 
TWO  PROCESSES  UNDER  CONSIDERATION  CAN  BE  AN 
UNDERWATER  ACOUSTIC  SOURCE  AND  RECEIVER  PAIR 
OR  TWO  RECEIVER  PAIRS. 

-NEXT  SLIDE  PLEASE- 


ACOUSTIC  SOURCE 


One  physical  problem  that  motivates  this 
RESEARCH  IS  THE  DESIRE  TO  PASSIVELY  ESTIMATE 
GEOGRAPHICAL  INFORMATION  ABOUT  THE  STATE  OF  AN 
ACOUSTIC  SOURCE.  In  THE  DEVELOPMENT  HERE,  AN 
ACOUSTIC  POINT  SOURCE  RADIATES  SPHERICAL  WAVES 
THAT  ARE  RECEIVED  FIRST  AT  ONE  SENSOR  AND  SOME 
DELAYED  TIME  LATER  AT  A SECOND  SENSOR.  THE 
SOURCE  IS  ASSUMED  STATIONARY  FOR  THE  OBSERVATION 
PERIOD  AND  THE  SENSOR  SEPARATION  IS  ASSUMED 
known.  Each  received  waveform  is  observed  in 
THE  PRESENCE  OF  UNCORRELATED  NOISE.  THE  PRO- 
BLEM WE  ADDRESS  HERE  IS  THE  PHYSICAL  INTER- 
PRETATION OF  THE  COHERENCE  FOR  THIS  MODEL. 

-NEXT  SLIDE  PLEASE - 
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A SOURCE  SIGNAL  S EXCITES  THE  MEDIUM  TO 
YIELD  AN  OUTPUT  Z.  THIS  OUTPUT  Z IS  CORRUPTED 
BY  ADDITIVE  NOISE  n AND  RECEIVED  AS  T.  We 
CONSTRUCT  A LINEAR  MODEL  OF  THE  MEDIUM  THAT 
GENERATES  AN  OUTPUT  HI  . By  PROPER  CHOICE  OF 
THE  MODEL  HE  CAN  MINIMIZE  THE  MEAN  SQUARE  ERROR 
e,  OR  DIFFERENCE  BETWEEN  THE  RECEIVED  SIGNAL 
T AND  MODEL  OUTPUT  ID  . ThE  MAGNITUDE  SQUARED 
COHERENCE  BETWEEN  SOURCE  AND  RECEIVER  IS  GIVEN 
BY  THE  RATIO  OF  THE  MODEL  OUTPUT  POWER  TO  THE 
RECEIVER  OUTPUT  POWER.  SINCE  GAMMA  SQUARED  IS 
BOUNDED  BY  UNITY,  IT  PROVIDES  AN  INDICATION  OF 
WHAT  PORTION  OF  THE  RECEIVED  POWER  CAN  BE 
ATTRIBUTED  TO  A MINIMUM  MEAN  SQUARE  ERROR 
LINEAR  MODEL  OF  THE  OCEAN  MEDIUM.  The  POWER 
RATIO  OF  THE  OCEAN  OUTPUT  DUE  TO  THE  SOURCE 
VERSUS  AMBIENT  IS  ALSO  DIRECTLY  RELATED  TO  THE 
SOURCE-TO-RECEIVER  COHERENCE.  In  PARTICULAR, 
THIS  SIGNAL-TO-NOISE  RATIO  IS  GIVEN  BY  GAMMA 
SQUARED  OVER  ONE  MINUS  GAMMA  SQUARED. 

-NEXT  SLIDE  PLEASE- 


IN  THE  GENERAL  CASE,  WE  CAN  MODEL  THE 
ACOUSTIC  PROPAGATION  OF  A SIN6LE  ACOUSTIC  SOURCE 
AND  NOISE  CORRUPTED  RECEPTION  AT  TWO  RECEIVERS 
AS  SHOWN  HERE.  In  PARTICULAR,  WE  TREAT  THE  PATH 
FROM  THE  SOURCE  TO  EACH  RECEIVER  AS  A LINEAR 
TIME  INVARIANT  FILTER.  THE  RECEIVER  SIGNALS  I* 

SUB  J AND  r SUB  K CONSIST  OF  THE  FILTER  OUTPUTS 
PLUS  NOISE. 

A SPECIAL  CASE  OF  THIS  MODEL  IS  WHEN  THE 
FIRST  RECEIVER  WAVEFORM  CONSISTS  OF  SIGNAL  PLUS 
NOISE,  AND  THE  SECOND  RECEIVED  WAVEFORM  CONSISTS 
OF  AN  ATTENUATED  AND  DELAYED  SIGNAL  IN  THE 
PRESENCE  OF  UNCORRELATED  NOISE.  The  MATHEMATICAL 
PROBLEM  OF  ESTIMATING  THE  TIME  DELAY  OR  EQUIVALENT 
SOURCE  BEARING  AND,  THUS,  SOURCE  RANGE.  IS  CLOSELY 
RELATED  TO  COHERENCE. 

Under  certain  assumptions  we  can  show  that 
THE  MAGNITUDE  SQUARED  COHERENCE  BETWEEN  TWO 
RECEIVER  PAIRS  IS  THE  PRODUCT  OF  THE  INDIVIDUAL 
SOURCE-TO-RECEIVER  COMBINATIONS.  THUS,  THE 
RECEIVED  SIGNAL-TO-NOISE  RATIO  IS  THE  RECEIVER- 
TO-RECE IVER  MAGNITUDE  COHERENCE  OVER  ONE  MINUS 
THE  RECEIVER-TO-RECEIVER  MAGNITUDE  COHERENCE. 

-NEXT  SLIDE  PLEASE- 


Now  THAT  COHERENCE  HAS  BEEN  DEFINED,  IT  IS 
APPROPRIATE  TO  DISCUSS  ITS  ESTIMATION.  FROM  EACH 
OF  TWO  FINITE  DURATION  MEMBER  FUNCTIONS  OF  CAPITAL 
N SEGMENTS,  WE  WEIGHT  EACH  SEGMENT  BY  A SMOOTH 
WEIGHTING  FUNCTION,  COMPUTE  ITS  DISCRETE  FOURIER 
TRANSFORM  VIA  AN  FFT,  AND  DENOTE  THEM  A SUB  n 
AND  B SUB  n . At  any  particular  frequency,  the 
COMPLEX  COHERENCE  IS  ESTIMATED  BY  COMPUTING  THE 
THREE  SUMMATIONS  SHOWN  OVER  THE  AVAILABLE  CAPITAL 
N SEGMENTS.  THE  LOWER  CASE  11  DENOTES  THE  n -TH 
DATA  SEGMENT  AND  THE  FREQUENCY  INDICATOR  IS  NOT 

shown.  In  the  numerator,  we  multiply  the  FFT  of 

THE  A PROCESS  BY  THE  COMPLEX  CONJUGATE  OF  THE 
FFT  OF  THE  B PROCESS  AND  SUM  OVER  N SEGMENTS 
TO  OBTAIN  AN  ESTIMATE  OF  THE  COMPLEX  CROSS  SPEC- 
TRUM. In  the  denominator  we  sum  the  magnitude 
SQUARED  FFTs  OVER  THE  N TIME  SEGMENTS.  UNDER 
CERTAIN  SIMPLIFYING  ASSUMPTIONS  6IVEN  IN  THE 
CONFERENCE  RECORD  WE  CAN  DETERMINE  THE  STATISTICS 
OF  THIS  ESTIMATOR. 

-NEXT  SLIDE  PLEASE- 
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In  the  conference  record  he  discuss  hoh  to 

DETERMINE  THE  CONFIDENCE  BOUNDS.  FOR  A PARTICULAR 
NUMBER  OF  FFT  AVERAGES  (N  - 8)  AND  A PRESPECIFIED 
CONFIDENCE  BOUND  (95X),  WE  OBTAIN  THE  TWO  CURVES 
SKETCHED  HERE.  WHEN  WE  OBTAIN  AN  ESTIMATE  OF 
GAMMA  SQUARED  FROM  THE  SAME  NUMBER  OF  FFTs  AS 
USED  TO  DRAW  THE  CURVES.  WE  USE  THESE  CURVES  TO 
DETERMINE  CONFIDENCE  BOUNDS.  In  PARTICULAR.  IF 
WE  HAVE  AN  ESTIMATE  DENOTED  BY  AN  X ON  THE 
ORDINATE.  WE  DRAW  A HORIZONTAL  LINE  FROM  THE  X 
UNTIL  IT  INTERSECTS  BOTH  CURVES.  THEN  WE  DROP 
TWO  VERTICAL  LINES  TO  THE  ABSCISSA  AND  THESE  ARE 
THE  CONFIDENCE  BOUNDS.  WE  CAN  THEN  STATE  THAT 
THE  TRUE  VALUE  OF  GAMMA  SQUARED  LIES  IN  THE 
REGION  BOUNDED  BY  THE  TWO  ABSCISSA  VALUES  WITH 
THE  PRESPECIFIED  CONFIDENCE.  FOR  EXAMPLE.  WITH 
EIGHT  FFTS  AND  AN  ESTIMATE  OF  0.7,  THE  95X  CON- 
FIDENCE BOUNDS  ARE  0.3  AND  0.86.  With  128  FFTs 
AND  AN  ESTIMATE  OF  0.3,  THE  BOUNDS  ARE  0.2  AND 
0.38.  Thus,  the  bounds  are  large  even  when  the 
NUMBER  OF  FFTs  IS  LARGE. 

-NEXT  SLIDE  PLEASE- 


IN  CONCLUSION,  WE  HAVE  LOOKED  AT  WHAT  THE 
COHERENCE  IS.  We  HAVE  SEEN  THAT  IT  IS  A NORMALIZED 
CROSS  SPECTRUM  THAT  CAN  PROVIDE  A MEASURE  OF  SIGNAL- 
TO-NOISE  RATIO  AND  THE  EXTENT  TO  WHICH  THE  OCEAN 
MEDIUM  CAN  BE  MODELED  BY  A LINEAR  FILTER.  In 
TERMS  OF  MEASURING  COHERENCE,  WE  HAVE  PRESENTED 
ESTIMATION  EQUATIONS  THAT  DEPEND  ON  THE  APPLICATION 
OF  SMOOTH  WEIGHTING  FUNCTIONS  AND  LARGE  NUMBERS  OF. 

of  FFTs.  These  computational  difficulties  result 

IN  LARGE  BOUNDS  ON  THE  COHERENCE  ESTIMATES. 

In  summary,  the  coherence  is  an  extremely 

USEFUL  DESCRIPTOR  IN  UNDERWATER  ACOUSTICS  THAT 
CAN  BE  ESTIMATED  WITH  CAREFUL  ATTENTION  TO  DETAIL 
AND  LARGE  NUMBERS  OF  FFTs. 

-SLIDE  OFF- 

ARE  THERE  ANY  QUESTIONS? 
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a smooth  weighting  function  to  reduce  side- 
lobe  leakage;  and  4)  each  data  segment  Is 
sufficiently  long  to  ensure  adequate  spec- 
tral resolution. 

The  NSC  Is  useful  In  detection,  see 
for  example  [2]  and  [3]  , but  Is  also  of 
value  In  estimating  the  amount  of  coherent 
power  eoomon  between  two  received  signals. 
Therefore  It  would  be  desirable  having 
estimated  a particular  value  of  NSC  to 
state  with  certain  confidence  that  the  true 
coherence  falls  in  a specified  interval. 
Early  attempts  to  do  this  for  95%  confid- 
ence were  accomplished  by  Haubrich  [4]  who 
apparently  used  precomputed  CDF  curves  and 
used  a different  method  of  presentation 
than  the  one  used  here.  Related  confidence 
work  for  the  magnitude  coherence  (SIC)  or 
squareroot  of  (2)  Is  presented  by  Eoopuaas 
[5].  Empirical  results  tor  95%  confidence 
are  given  by  Benlgnus  [6]. 

DETERMINING  CONFIDENCE  B00SPS 

Let  C be  the  true  but  unknown  parame- 
ter and  C be  its  estimate.  Then  there 
exists  a family  of  CDFs  such  as  the  two 
sketched  la  Tig.  (1)  for  all  values  of  C 
and  S.  Tor  a fixed  value  of  N,  a number  of 


la  underwater  acoustics  where  signals 
are  digitally  processed  at  the  outputs 
of  two  or  more  receiving  sensors.  It  Is 
desirable  to  estimate  the  coherence 
spectrum,  both  for  detection  and  position 
estimation.  A processing  technique  for 
computing  arbitrary  confidence  bounds 
for  stationary  Gaussian  signals  Is  pre- 
sented. New  computationally  difficult 
examples  are  given  for  80  to  95%  confid- 
ence with  independent  averages  of  8,  16. 
32,  64  and  128.  A discussion  of  the 
computational  difficulties  together  with 
algorithmic  details  are  presented. 


INTRODUCTION 


The  magnitude-squared  coherence  (NSC) 
between  two  jointly  stationary  random 
processes  x(t)  and  y(t)  Is  defined  as 


where  Gxy(f ) is  the  cross-spectral  density 
at  frequency  f and  G^f)  and  Gyy(t)  are 
the  autospectral  densities.  The  NSC  can 
be  estimated  as  la  [l]  by 


where  • denotes  complex  conjugate,  N Is 
the  number  of  data  segments  employed,  and 
X^f)  and  Tn(f)  are  the  fast  Fourier 
Transform  (FTT)  outputs  of  the  nth  data 
sepients  of  x(t)  and  y(t).  Both  the  NSC 
and  Its  estimates  are  bounded  by  zero  and 
unity.  The  eummulatlve  distribution 
functions  (CDF)  for  the  NSC  estimate  la  (2) 
have  been  determined  in  f 1 ] under  the 
assumptions  that  1)  the  data  are  jointly 
stationary  Gaussian  random  processes;  2) 
the  M data  segments  are  independent;  3) 
the  data  segments  have  been  multiplied  by 
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TIG.  (1).  PLOT  OF  CDF  CURVES  FOR 
N-f,  01/3.  AND  N-8.  02/3 


CDF  curves,  such  ss  plotted  is  Fig.  (1), 
are  generated,  for  various  values  of  C. 

For  each  of  the  numerous  CDF  curves,  we 
select,  as  closely  as  possible,  the 
abscissa  values  such  that  the  ordinate  val- 
ues FL8  minus  FL7  yield  the  desired  con- 
fidence. The  confidence  intervals  are  not 
unique,  since  there  is  no  constraint  such 
as  FL8  equal  FL7.  Ve  have  selected  FL8 
equal  FL7  but  could  have  selected  FL8  and 
FL7  such  that  the  difference  in  abscissa 
values  In  Fig.  (1)  CONUP(C)  minus  CONLO(C) 
was  minimum.  However,  as  long  as  FL8  minus 
FL7  equals  the  desired  confidence  the 
method  presented  here  is  correct.  Now  we 
plot  CONUP(C)  and  CONLO(C)  versus  C for 
this  particular  value  of  N.  A result  is 
sketched  in  Fig.  (2). 


and  128  from  outer  to  inner,  respectively. 
Having  made  an  estimate  with  a particular 
value  of  N,  only  one  pair  of  curves  applies. 
An  excellent  discussion  of  the  types  of 
statements  that  can  be  made  with  confid- 
ence bounds  is  given  by  Cram&r  (7]. 

Suppose  we  obtain  an  estimated  USC  of  0.7 
from  N ■ 8 disjoint  FFTs,  then  we  draw  a 
horizontal  line  from  0.7  on  Fig.  (3b)  for 
confidence  limits  and  see  where  it 
intersects  the  pair  of  K ■ 8 (outer)  curves. 
This  occurs  at  (approximate  abscissa 
values)  0.3  and  0.88.  Thus  we  state  with 
95%  confidence  that  the  true  but  unknown 
parameter  C falls  in  the  interval  (0.3, 

0.86).  No  matter  what  the  true  value  of  C, 
we  have  a 5%  probability  of  giving  an 
incorrect  statement.  That  is,  if  we  make 
many  estimates  of  MSC  and  keep  applying 
the  rule  described  (whether  or  not  C is 
random  or  constant)  we  will  correctly  in- 
clude the  true  value  of  C in  the  interval 
that  we  specify  95%  of  the  time.  Some- 
times the  method  of  applying  the  rule  is 
in  doubt  as  for  example  in  Fig.  (3b)  if 
the  estimate  comes  out  to  be  0.3  and  N ■ 8 
then  a horizontal  line  does  not  Intersect  the 
upper  confiueuce  limit  curve  unless  we 
extrapolate  it  backwards.  Doing  'his  means 
making  statements  like:  with  95%  confid- 
ence the  true  MSC  is  in  the  region  (-0.1, 
0.62).  Since  we  know  apriori  that  the 
true  value  of  C is  non-negative,  we  could 
just  as  easily  say  (but  with  no  more 
confidence)  that  with  95%  confidence  (for 
N ■ 8 and  C • 0.3)  the  true  MSC  falls  in 
the  region  (0.0,  0.62).  Moreover,  if  both 
intersections  result  in  negative  regions 
(aa  for  example  when  C ■ 0.001  and  N ■ 8) 
we  may  have  to  make  statements  like  with 
80%  confidence  the  true  MSC  lies  in  (0.0, 

0. 0..  However,  if  we  continue  to  apply  the 
rule  and  run  the  experimental  trials  we 
will  make  correction  statements  “80%''  of 
the  time.  It  is  interesting  to  note  that 
due  to  the  properties  of  the  estimate  and 
our  selection  of  FL7  and  FL8  that  larger 
values  of  N do  not  always  result  in  the 
upper  confidence  bound  being  lower.  This 
also  occurs  in  MC  estimate  confidence 
limits  £5].  xt  is  also  Interesting  to 
note  that  while  increasing  N is  desirable, 
the  confidence  bounds  for  N - 128  are  still 
very  large.  For  example,  even  when  N * 

128  if  C ■ 0.3  the  95%  confidence  intervals 
are  still  (0.2,  0.38)  and  the  80%  confid- 
ence intervals  (0.24,  0.38)  are  not  much 
better. 
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FIG.  (2).  HANDSKETCH  OF  CONFIDENCE 
BOUNDS  FOR  A PARTICULAR  VALUE  OF  N 


MAKING  CONFIDENCE 
ABOUT  USC  ESTI! 


A computer  program  has  been  written  to 
evaluate  the  CDF  and  confidence  limits. 

The  mathematical  details  of  the  CDF  as  a 
finite  sum  of  F21  hypergeometric  functions, 
each  one  a polynomial,  are  given  in  [2], 

For  large  values  of  N and  C,  a brute  force 
approach  to  computing  the  CDF  results  in 
numeric  overflows,  attempts  to  avoid  this 
problem  can  result  in  underflows  or  other 
inaccuracies.  The  program  listed  in  the 
Appendix  avoids  these  difficulties,  it  also 
Incorporates  CDF  values  when  C equals  zero 
or  unity,  since  these  can  be  computed  in 
closed  form. 

Figures  (3a)  and  (3b)  are  computer 
generated  80%  and  95%  confidence  limits, 
respectively.  The  five  pairs  of  curves 
la  each  figure  are  for  N • 8,  16,  32,  64, 
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PROGRAM  FOR  CONFIDETCS  BOUNDS 
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S10  Ksl'LOO 


Z=£*C 


XF  [Z  .F.Q.  0)  «0  TO  MO 


COH=( IC-U /FLOAT (NC-l) 


F2sC0NUP (lflOfIC) 


F4=C0NUP(2,IJ*IC) 
nOrn<p  Li  m . .fflMtPI  • 


630  FORMAT (1X*I5*5F6,3) 

j I]  A Aftl.TfMI  IC" 


call  COMPRS 


FIL=65*(IL*15J 


CALL  FRAME 
SR 


CALL  6RI0( 1> 1) 

0 740  TJS3.NN 


700  IC*1*NC 
X( 


TD  5881 
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